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SlTTlMiY 

Ttie feasibility of pupillcmetry as an indicator for assessinft op- 
erator \Morlcload during: nanual trackinpr v/as studied. The mean and max- 
itTun pupillary responses of 12 subjects performinfi: tracking: tasks with 
three levels of difficulty (bandv.'idth of the forcing function were 
0.15, 0.30 and 0.50 Mz respectively) were analysed. The results 
showed that pupillary dilation increased sifmif icantly as a function 
of the trackinr difficulty v.tiich was reflected by the sicnifica..t in- 
crease of tracking: error (n’t?). The present study supplies additional 
evidence that pupillary response is a sensitive and reliable index 
v/hich may serve as an indicator for assessinr operator v.^rkload in 
rnan-rwehine systems. 


n^irmmoN 


The assessment of operator workload in connplex man-machine sys- 
tems has become more important for cvnluatinf: and enhancing: the over- 
all system performance as systems become more advanced and sophisti- 
cated. The traditional methods for cvaluntinR the workload are sub- 
jective evaluation (Cooper, i9(?9), measures of primary and secondary 
task performance, and systems or enninccrinfT analysis. Results have 
shown tliat neither any single approach nor combination of methods can 
assess or predicate the workload adequately. 

Physiolopgieal paraineters, however, have manifested themselves as 
potential indicators in workload assessment (iVierwille and Killipres, 
1978). Tfioso indicators may reflect the dynamic change of the func- 
tional status of the operator induced by the task before oi without 
performance decrement (Strasser, 1977). Of the physiolog^icnl measures 
indicating: momentary cofnitive workload, pupi llometric response ap- 
pears to he most sensitive and reliable (Kahneman, 'Airsky, Shapiro, 
and f'rider, 1959). For cognitive processings, multiple neurophysiolog- 
ical assessment iins been emphasized recently since the hypotheses of 
multiple and hiorachical resources v«re pointed out (Wickens,1980, Be- 
atty, 1980). EHTt seems to be a potential indicator both for fjeneral 
and specific brain activation if multiple channels of EEC could be an- 
alysed (Barth and Itentty, 1981, unpublished report). EBfi studies dur- 
ing: manual tracking: siiow that the theta waves increase as a function 
of tracking'’ difficulties (Jiangj, Long:, He and Zhao, 1977, unpublished 
report), lastingr period and performance decrement (Kornfeld and Bcnt- 
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ty, 1977). It seerB plausible to interpret this phenomenon as due to 
either an increase of trackinff difficulty or as a result of tryinj^ 
best to attain the desired perfonmnee as the experiment demands. The 
study of psychophysiolopical mechanisms of theta waves indicates that 
they are related to information processing and mental effort 
(Schacter, 1977). 

Task-evoked pupillary responses have been studied extensively in 
cognitive tasks and practical implications for operator workload meas- 
urement has been suggested (Realty, 1989). As a part of the study of 
multiple assessment of operator workload, the effect of trackinff dif- 
ficulty on pupillary responses was studied in the present experiment 
and the feasibility of pupil lometry for assess inft operator workload 
was discussed. 


j'UTnrr 

'R'jelve university students participated this experiment as sub- 
jects. '"he manual trackinp: system consisted of an auditory display, a 
finn;er joystick and a controlled element (K/S, simulated by ana'off 
computer). 

'The difficulty of liie was determined by the bandwidth of the 
forcinf' function. 'The cutoff frequencies were low (0.15 Hz), medium ( 
0.30 Hz) and hi^h (0.50 Hz) correspond inrr to easy, meditm and hard 
trackinff respectively. 'Hie period ol ♦ime of tracking: for eae’i trial 
was 10 seconds startinft with a warning sij^nal, the word "ready”. One 
second after this signal, the tracking forcing function (converted to 
a single tone) appeared in either of the two earphones. 'The pilch of 
the tone was proportional to the voltage of the forcing function or 
the tracking error. 'Hie subject was asked to control the stick later- 
ally away from the car in which the tone was heard. 'Hiis in turn re- 
duced the magnitude of the tracking error and the perceived pitch of 
the tone. Zero error corresponded to 500 Hz of the tone. The posi- 
tive error was displayed in the left earphone and the negative in the 
right. For each level of difficulty of tracking, there were 20 trials 
of practice in order to attain a steady level of pcsrformance. After 
practice the data of pupillary response and tracking error (reS) were 
acquired and stored in the computer. Pccausc of a programming mal- 
function, the n't? tracking error data was obtained for only 9 of the 
1? subjects. 'There were T*' trials of tracking for each level of dif- 
ficulty. 'Hie order of these levels for tho subjects to track was 
counterbalanced. 

Vortical pupillary diameter was measured by a 'TV Pupillcmetor 
System for 10 seconds follofiving the ^varning signal. The tracking 
error were recorded for 9 seconds during tracking. Pupillary res- 
ponses were analysed using tho program of this laboratory, and the 
mean and mnximri amplitude of dilation during tracking relative to the 
1 sec. baseline ivere computed. 
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RESUL're and DISCUSSION 


Trackirif? {performance; Trackinyr error (RTB) increase<i sifmifi- 
cantly with the bandv/idth of the forcinsr function (F(2,8) =•17 . R5 1 
P<.005). TTiis result is consistent with other studies inHicatinpr that 
the bandwidth of forcin'^ function can be used as a factor to modify 
the trnckinfT difficulty. 

Pupillary responses; As shown in Fip. 1, the mean and maximin 
amplitude of the pupillary responses durinii; trackinp increased with 
trackincr difficulty. 'Diese increases were significant (F(2,ll)=6.44 
P<0.025, for mean dilation; F(2,ll)= 6.13, PC0.025, for mnxirmn dila- 
tion). The mean pupillary dilations were 0.274 nm, 0.33? rmi, and 
0.377 nm, and the maxinun dilations 0.377 mn, 0.440 rnn, and 0.402 rm 
for the three levels of difficulty respectively. The peak dilations 
were approximately comparable to those evoked by short term memory 
tasks with 5, 6, and 7 items (Peatt>, 1080), and the pupil dilation 
during easiest tracking even reached the magnitude evoked by a choice 
reaction tine test with 8 alternatives (Beatty and V.'agoner, 1080). 
Tlic foundation of inter-task comparisons is based on the findings that 
1' ^ magnitude of pupillary responses during cognitive processing is 
; .dependent of baseline pupillary diameter over a physiologieal ly rea- 
sonable range of values (Bradshaw, 1060). 

The grand averages of pupillary responses duing tracking over 12 
subjects are plotted in Fig. 2, which shoivs the time history of the 
pupillary responses. It displays a stage of preparation for activa- 
tion Dcfore tracking; a stage of fast dilation of pupil irnrcdiately 
following tracking; a stage of maintaining dilation; and a stage of 
a little constriction before stopping tracking. It is obvious that 
the effect of tracking effort on the pupillary response is dominantly 
reflected in the mnximiin difference but also in other stages. For in- 
stance the constricting stage lasted longer in the easy tracking just 
before rest and the magnitude of constriction was greatest in the 
hardest tracking case. V.tiethcr the latter phenomenon is due to the 
individual differences or due to overload of the task for some sub- 
jects as pointed out by Peavler (1974) should bo tested by further 
study. 

'Hie available reports published so far on the physiological as- 
sessment of worklo.ud during trucking shmv that even though some physi- 
ological indicators are sensitive to significant differences between 
rest and tracking, tney are unable to discriminate the different lev- 
els of tracking difficulty, for instance the heart rate variability 
(Ilyndnnn and Gregory, 1975) and event related potentials (isreal, 
Hiesney, U’ickens, and Donchin, 1980). The present result supplies ad- 
ditional evidence that pupillary response is a sensitive and reliable 
index for measuring mental effort. 

As for the tcchni(;uc of the rjupil recording, there is still a lot 
to bo inproved in order to be nv>re convenient .and less constraining 
for the subject, particullary for the '‘oerators performing tasks in a 
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real \MorkinR condition. Owinp to the ^reat individual differences in 
the size of the eyes and the pupilt color of the iris, and the 
ability to keep the eyes relatively fixated without blinkinft, the sub- 
jects should be selected appropriately. 

This study only analysed the effect of auditory trackinfr on the 
pupillary responses, but the individual studies usinpr visual display 
also revealed the tendency of pupillary dilation as the difficulty in- 
creased and residual attention loivered (McFeely, 1972). 

One can conclude that pupillary responses can discriminate opera- 
tor effort during tracking and can be errnpared with those evoked by 
other tasks. Fiirthermore, the innovation for the recording system is 
possible, iience, pupillonetry may serve as a promisini? indicator to 
assess the operator workload in man-machine systems, particularly with 
additional indicators such as FBTi or others which con reflect the ac- 
tivities of specific resources of coprnitivc prooessinf'. 
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Pig. 1 Mean and maximum pupillary dilations and RMS tracking error (arbitrary 
units) for three levels of forcing function bandwidth (low, medium and high). 



Seconds 

Fig. 2. Grand average of pupillary responses across 12 subjects 
for three levels of forcing function bandwidth (low, medium, 
and high). 
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